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This aanual was conceived as a reference guide for 
Illinois* 18 library systeas to use in their long-range planning and 
evaluation prograa. Section 1 of the aanual explains the planning 
■odel: Context Input Process Product (CIPP) . CIPP was selected as a 
coherent adaptation and aodification of aany previous planning and 
design aethods: systeas analysis, prograaed instruction, and Planning 
Prograaing Budgeting Systea (PPBS) . it consists of four aa jor steps: 
context evaluation (identifying the environaent/setting goals and 
objectives) ; input evaluation (selecting alternatives) ; process 
evaluation (iapleaentation) ; and product evaluation (assessing final 
results) , Further explanation is provided on the process of 
generating library goals and objectives. Finally the CIPP aodel is 
applied to the central interlibrary loan operation of a hypothetical 
public library; question foraulation, goal setting, and 
iapleaentation activities. A flowchart of the CIPP aodel, a glossary 
of teras, report writing foras and procedures, and a bibliography are 
appended. (Author/SL) 
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FOREWORD 



Sections II* III and V are suggested for readers 
desiring an abbreviated introduction to the fundamentals of 
the CIPP model. The entire manual should be read by those 
embarking on a comprehensive planning effort. 



I. PREFACE 

This manual was prepared by the Library Research Center, 
University of Illinois at Urbana-Champaign, under a grant from 
the Illinois State Library, Springfield, Illinois. The manual 
was conceived as a reference guide for Illinois' eighteen 
library systems to use in their long-range planning and evalua- 
tion programs. Starting in the summer of 1973, visits were 
made to each systom to discuss the manual and to furnish 
additional data about the planning project. Many supplemental 
visits and consultations between the Library Research Center 
and system personnel were also undertaken. Each library system 
was permitted meiximum autonomy in the development of their 
plans. Because planning/evaluation and the model (Context, 
Input, Process, Product) explicated in this manual have not 
been applied to an entire state before this time, some repeti- 
tion of concepts and examples was considered essential. Both 
the manual and the five-year plans being developed by the 
systems have emphasized library services in contrast to purely 
internal operations. Finally, this manual is designed to pro- 
vide general guidance for assessing library services and for 
formulating goals, objectives, and criteria to measure program 



attainment. No attempt has been made to delineate or resolve 
the complex issues involved in the derivation and standardiza- 
tion of library measures. 



II. PIANNING AND EVALUATION: DEFINITION AND RATIONALE* 

Planning is a process of preparing a set of decisions for 
future action and is directed toward achieving objectives by 
optimal means. This requires decision making, which in turn 
requires reliable data. Evaluation is the process of delineating, 
obtaining, and providing information for managers and staff. 
It is a system of informational feedback. Evaluation provides 
the decision maker with information with which to make judg- 
ments about current progress and future needs. It is important 
to distinguish between the roles of evaluator and decision 
maker. The evaluator assists in designing a viable information 
system and the decision maker is responsible for evaluating 
the information and making policy judgments. 

There are two interrelated rationales for the introduction 
of formal planning and evaluation procedures. The first benefit 
relates to operational efficiency and effectiveness. Applica- 
tion of planning techniques requires a rigorous analysis of 
available resources, user needs, and alternative strategies. 

* 

Adapted from Daniel L. Stuff lebeam, "The Relevance of 
the CIPP Evaluation Model for Educational Accountability." in 
David D. Thomson, ed.. Planning and Evaluation for Statewide 
Library Development; New Directions , pp. 24-33. 
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Evaluation, generally the weakest link in planning activities, 
focuses on the means of measuring progress from stated goals 
and objectives to final results. A comprehensive approach to 
evaluation should provide for the monitoring of organizational 
activities during the preliminary, intermediate, and final 
stages. A second value of planning and evaluation relates to 
the concept of accountability. Accountability involves both 
the reciprocal responsibilities of manager and professional 
within an organization, and the relationship between an organi- 
zation and its external constituencies. Internally, an organi- 
zation should have clearly articulated tasks and expectations 
for each professional and an equally pxecise statement of 
management responsibilities. Externally, an organization 
should be obligated to justify or account for the effectiveness 
or impact of its essential mission. 

Both aspects of accountability require that organizational 
goals be specified and measurable whenever possible. And the 
specification of goals and objectives is dependent upon the 
establishment of a systematic approach to the procurement and 
evaluation of information for decision making and evaluation. 
Finally, accountability and planning achieve optimum results 
when accompanied by a broad involvement of management, staff, 
and client in the planning/evaluation process. 
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III. CONTEXT INPUT PROCESS PRODUCT (CIPP) MODEL 



There are many planning models. We shall work with a 
model known as Context Input Process Product (CIPP). This model 
was adopted because of its relative simplicity and the existence 
of a sizable body of explanatory literature. It was developed 
and refined by the Evaluation Center of Ohio State University. 
The Ohio State University Evaluation Center conducted several 
seminars during 1971-72 on the applications of the CIPP model 
to state-wido library planning. 

The CIPP model is neither a radical planning innovation 
nor a how- to-do-it kit. It is a coherent adaptation and 
modification of many previous planning and design methods: 
systems analysis, progreunmed instruction, and Programming 
Planning Budgeting System (PPBS) . As with all theoretical 
presentations, the CIPP model should be considered as a frame- 
work to guide thinking. It ensures an analytical approach by 
requiring planners to answer essential questions and to make 
specific judgments at key points in the planning process. CIPP 
does not prescribe the specific research techniques (e.g., 
survey questionnaires, time and motion studies) that should be 
employed. 



FOUR MAJOR CIPP STAGES 



1. Oontext evaluation provides information about needs, 
problems, and opportunities in order to identify goals, 
objectives, and their associated criteria. 

2. Input evaluation provides information about the strengths 
and weaknesses of alternative strategies for achieving 
objectives. 

3. Process evaluation provides information about the 
strengths and weaknesses of a strategy during implemen- 
tation so that it may be strengthened or eliminated. 

4. Product evaluation provides information for determining 
whether objectives are being achieved and whether the 
procedure employed should be continued, modified, or 
terminated. 



Context (Planning) 


> 


What's Out There? 


Input (Structuring) 


> 


How to Do It? 


Process (Implementing) 


> 


Are We Doing It? 


Product (Recvcling) 


^ 


Did We Do It? 



For a graphic representation of the CIPP model, see 
diagram (Figure 1) on the next page. A more detailed flow- 
chart of CIPP can be found in the Appendix. 

Each of the four CIPP stages is related to the processes 
of delineating, obtaining, and providing pertinent information 
for decision making. The relationships between the CIPP 
stages and the three informational gathering/disseminating 
activities are elaborated in Figure 2. 
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CONTEXT (Identifying the Environment/Setting Goals and 
Objectives) 

Context evaluation involves a detailed description and 
assessment of the library system's enviroriment* Major aspects 
of the environment that are analyzed in this phase are user 
needs<, unused opportunities, competing sources of information, 
inter-institutional arrangements, demographic characteristics 
of the user (and non-user) community, personnel/financial 
strengths and weaknesses, and the system's decision making 
structure. From this evaluation, tentative goals and 
objectives to meet future needs are formulated. Constructing 
measurable objectives is the most critical step in the Context 
stage. Briefly, a measurable objective should incorporate one 
or more directly measurable criteria or standards against which 
progress toward the objective's stated purpose can be assessed. 
These criteria constitute the operational measures which are 
applied and analyzed during the Process and Product phases of 
the CIPP model. Alternative actions and activities to imple- 
ment the goals and objectives are the subject of the Input phase, 
discussed in the next paragraph. 

INPUT (Selecting Alternatives) 

One of the most neglected areas in program planning is 
consideration of alternative approaches or strategies to achieve 

ERIC 
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previously identified goals and objectives* The temptation to 
select a familiar or convenient strategy is compelling. But 
the obvious strategy will not always satisfy the needs and 
opportunities of the situation. Creative exploration of alterna- 
tive routes will pay dividends during the implementation and 
final assessment stages. 

Input decisions are based on a host of factors, including 
staff resources, availability of funds, and time constraints. 
Cost implications and projected completion times are especially 
important variables in the process of selecting alternatives. 
Planning techniques such as the Program Evaluation Review 
Techniques (PERT) are helpful in ascertaining optimal project 
completion dates. Once a strategy has been chosen, specific 
staff responsibilities for each part of^the project should be 
assigned, 

PROCESS (Implementation) 

Process evaluation involves monitoring a program during 
the implementation and tryout stages so that modifications, as 
appropriate, can be considered, A planning document should 
stipulate reasonable intervals at which a project will be 
assessed. Formal, continuous evaluation is an often overlooked 
aspect of the planning process, but a vitally important 



11 

operation* For it is only through periodic evaluation that the 
viability and effectiveness of programs can be ascertained 
before project completion and the expenditure of sometimes large 
amounts of money* It is preferable to eliminate or modify a 
project in the early operational stage than to find out about 
deficiencies when it is impractical to modify or reverse direc- 
tion* Several key questions to be answered during the Process 
phase are: Will this approach enable us to reach our objectives? 
Are we using the tactics we planned? What effect do extraneous 
variables have on the strategy? What factors other than criteria 
identified in the objectives should be evaluated to determine 
the strategy's success or failure? 

PRODUCT (Assessing Final Results) 

The final CIPP phase. Product evaluation, provides infor- 
mation concerning the degree to which overall goals and objec- 
tives have been achieved* Performance measures stipulated in 
objectives prepared during the Context phase are the major 
criteria against which a project's effectiveness should be 
assessed* For projects with a specified duration, the Product 
stage will coincide with the completion of an activity* For 
indefinite projects. Product evaluation serves as the major, 
formal analysis of a program's value and impact* Since the 
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Product phase emphasizes the impact of a service, the final 
evaluation should include reactions from both library staff 
and service users (and nonusers as appropriate) . Findings 
derived from the Product examination should be reduced to a 
written report. Such a report will allow all interested 
parties to review the evaluation and a permanent record will 
be available for future reference. 

DECISION MAKING AND THE PLANNING PROCESS 
As expressed earlier, a najor planning/evaluation effort 
should draw upon a representative group of persons to par- 
ticipate. It is unlikely that a long-range plan developed 
solely by a library manager would satisfy urers and command 
allegiance of the library staff. 

How should decisions be made? While there are many valid 
approaches to organizing for planning, some suggestions may be 
helpful. Carefully prepared, written agendas distributed in 
advance of planning sessions should accelerate discussion and 
decision making. Setting dates for the resolution^'of issues 
is often beneficial. The tendency to haggle and postpone 
decisions to the next meeting is a universal organizational 
problem. Productive meetings require that sufficient 
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information be available and so arranged that issues can be 
sorted out and acted upon with intelligent dispatch* 

None of the foregoing observations should be interpreted 
as a call for unanimity. Conflict and criticism is inevitable 
and healthy* The pros and cons of goals, objectives, strategies, 
performance criteria, and measurement techniques should be 
elicited throughout the planning sequence. 

SUMMARY 

Each phase of CIPP asks several key questions: 

CONTEXT — ^What's out there? Who are the users? VOiat do 
they need? What are our objectives? How will we 
measure results? 

INPUT — How will we implement the objectives? What are 
the alternative strategies? Why selected? 

PROCESS — ^Are we meeting the specified objectives 

during the implementation stage? Are there any 

unintended outcomes? 
PRODUCT — Have the terminal objectives and performance 

expectations been reached? Should we continue, 

modify, or terminate the project? 
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IV. MAJOR STEPS IN LIBRARY SYSTEM PLANNING* 

The outline which follows lists the essential elements of 
the four stages of CIPP in a question format. To answer some 
of these questions, the system's ongoing data collection pro- 
cedures may prove sufficient, while other questions will 
require some original investigation. This list is not intended 
to be exhaustive and should be adapted to local circumstances. 
Appendix C contains a brief checklist of questions (a reporting 
form) that can be used to record key information concerning 
each goal/objective. 

CONTEXT EVALUATION 

Decision Structures 

Decision structure is defined as the internal and external 
communication patterns, existing and desired, that enable 
decisions to be made. Pinpointing the authority and respon- 
sibility of persons involved in each major step of the planning 
and evaluation process should receive priority attention. The 
decision structure should be sufficiently described in the 
planning document to indicate the composition of the planning 
group, chain, of authority, focus of responsibility, decision 

schedules, and the criteria for making decisions. 
- 

From "Suggested Guidelines for Statewide Library Planning 
and Evaluation," In David D. Thomson, ed.. Planning and Evalua - 
tion for Statewide Library Development; New Directions , pp. 297-305. 

ERIC 
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There are decision structures in all four phases of CIPP 
(see CIPP flowchart in the Appendix) , but the function of the 
decision structure is most prominent in the Context phase. 
The input into the decision structure is a body of information 
and problems. The output from the decision structure is a 
judgment based upon that information. Judgments made at one 
decision structure flow into the next stage of CIPP and become 
the raw material for the next decision point. In this respect 
the CIPP model is linear. For example, the experience of 
monitoring a project in the Process .phase might reveal some 
additional variables that should be assessed during the sub- 
sequent product stage. CIPP is also cyclical in that decisions 
cycle back into previous decision structures. Cycling, or 
feedback, can be illusitrated by the decision to abandon an 
objective developed in the Context stage after an analysis in 
the Input phase demonstrated the objective's impracticality. 

Define the decision structure. 

1. What are the bases for decision making in the 
system? e.g.. Democratic? Centralized? 

2. Who has the legal authority to make decisions? 
Who has the delegated authority to do so? 

3. For each critical decision, who has the veto power? 

4. What non-system agencies will be affected by 
system decisions? How flexible are these 
external groups to change? 



5« What agencies or groups should share in the 

decision process? 
6. Can problems be dealt with through the existing 

institutional framework, and, if not, what 

changes in the organizational structure(s) 

must be made to resolve them? 
?• Which staff members are involved in the delivery 

of library services? 

a* What user groups do they serve? 

b. What particular services do they provide? 
8* What person or persons will direct the planning 

process and be responsible for making planning 

decisions? 

Identifying General Parameters 

A. What is the nature of the system, its general 
purposes and present institutionalized goals? 

B. What are the boundaries and major physical 
features of the geographical area (e«g«, political 
and civil subdivisions, important geographic 
features , etc • ) ? 

C« What is the size and composition of the popula- 
tion of the system area (e«g«, distribution, special 
characteristics, etc. ) ? 

What institutions, other than libraries might 

affect the use of libraries (e.g., 
industries, higher education institutions, 

prisons, etc. ) ? 



E. What institutions or services, other than libraries, 
are meeting, formally or informally, the needs for 
recorded information ( e * g * , bookstores , newsstands , 
rural extension services, etc*)? 
What is the library situation in the area? 
1* Who are the "served," who are the "unserved"? 

2. Who are the library users and who are the non- 
users? 

3. For what purposes are they using libraries? 

4. What are the strengths and weaknesses of system 
resources (e*g*, financial support, buildings, 
collection, staff, etc. ) ? 

5. What are the relationships, formal and informal 
(e.g., interlibrary loan patterns, networks and 
systems, reference, etc.) between the system 
and member libraries, and between the system 
and other systems, the four Research and 
Reference Centers, and the State Library? 

6. What are the economic, legal, political and 
other constraints which affect library service? 

What factors not covered in A - F above might bear 
on library service and use? 

Formal Assessment Activities 

While survey questionnaires and interviews are helpful, 
they can be over-used and system planning can become bogged 
down waiting months or even a year for results. The amount of 



original data to gather depends upon how much information is 
already available and the extent to which useful insights can 
be culled from the data. Information collection- should have 
a utilitarian orientation, serving as the basis for ascertain- 
ing unmet needs and constructing goals and objectives to serve 
those needs. For exEunple, a detailed analysis of library use 
patterns of an ethnic group known to comprise less than 1 porcent 
of the population would probably deserve a lower priority than 
a determination of the yet unknown percentage, dispersion, and 
library use habits of all citizens over the age of sixty-five. 

Current sources of data for a system are minutes 
of board meetings, its Plan of Service, statistics gathered by 
the system itself and those supplied by the State Library, 
consultants' reports of work with member libraries, library 
literature, input from the community, input from other systems 
and the procedures they use, other professionals both in the 
system and out of the state. Appendix B contains a rather 
extensive list of data categories which might profitably be 
explored. 

Figure 3 points out that needs assessment is performed 
in all four steps of CIPP. Some questions to consider in 
assessment activities are: 
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A. What activities have been conducted to assess the 
current and future needs of the community? Were 
these activities adequate to fully assess these 
needs? 

B. What are the current needs of library users? 

1. What groups or classes of users are 
currently served? 

2. How well ure these groups served? 

3. What unmet needs of users currently exist? 

4. What unmet needs of users will exist in the 
future? 

C. What future user needs should be translated into 
goals for library development? 

D. Is the nuiiiber and educational level of system and 
member library staff sufficient? What forms of 
continuing education are desirable? 

E. What actions will be required to select and to 
achieve goals for library system development? 

1. What decisions are required to identify 
priorities for possible goals? 

2. On what criteria will these priorities be based? 

3. What legislative or administrative enabling 
action will be required? 

4. What will be necessary to modify or adjust the 
processes of delivery of library services? 

5. What allocational needs with regard to financial 
and staff resources will be required? 
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Needs 

Needs are derived from assessment activities. Needs are 
then ranked according to priority based on criteria or standards 
Priority is based upon the urgency of clientele needs « the 
social utility of serving those needs, the linkage of such 
service to total community effort, the cost of the service, 
and the resources available. An example of a need derived from 
an assessment analysis might be a program of service to elderly 
housebound citizens. This need was ascertained from a finding 
that the library service area contained an unusually high 
number of senior citizens. 

Goals and Objectives 

Goals are abstract and broad. They reflect the ideal 
towards which the system works. A broad goal would be to 
improve library service to citizens in System X. The goal is 
then broken down to subgoals, e.g., to improve the quality of 
reference service in the system. From subgoals, broad objec- 
tives are then outlined. Prom broad objectives, flow more 
specific objectives. 

Goals — subgoals — ■> broad objectives — specific objectives. 
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A meaningful goal statement implies movement or progress 
from the present state of library services toward some specified 
ideal. In order to do this, certain information about the 
current si:atus of library service in the system should be 
presented. 

Some points to consider when formulating goals: 

1. What goals might feasibly be attained by the end 
of a five-year planning period? 

2. Aire the goals consistent with one another? 

3. Are the goals consistent with the goals of the 
State Library? Ideally, goals of the member 
libraries feed into system goals for planning 
and system goals feed into the State Library 
goals as stated in its five-year plan. In turn, 
the State Library's goals reflect the national 
picture of cooperative networl s. 

Objectives specify "what is to be done," "to what degree 
of success," "for whom," and "by when." If objectives are stated 
in this way they imply certain specific criteria against which 
to measure program attainment (see Figure 4) . Measurable 
objectives enable a program to be evaluated in a systematic 
manner, provide the stimulus for identifying strategies and 
activities to implement objectives, and constitute the basis 
for assigning task responsibilities to individual staff members. 
For a more detailed discussion of generating goals and objec- 
tives, consult Section V. 



Figure 4: GOAL/OBJECTIVE HIERARCHY 




GOAL 

To improve library service to 
handicapped persons. 

I 



OBJECTIVE 
Within six months, the library will 
evaluate and purchase 20 percent 
more "talking book" portable record 
players for use by blind citizens. 

1 ~ 

ACTIVITIES 
Secure technical literature and 
record players for exeunination. 
Execute purchase orders. 



TASK ASSIGNMENT 
Design, implementation, and 
monitoring of this objective shall 
be assigned to the Audiovisual 
Librarian. 
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Several standards may be used — individual system 
standards. Minimum Standards for Public Library Systems (1966) , 
Illinois Library Association Standards ( Measures of Quality ) , 
1972, and other state and American Library Association 
standards. The planning group decides which standards of 
criteria are most appropriate to their situation. 

Task assignments should not be made until all of the 
tasks necessary to accomplish various objectives have been 
delineated and their priorities have been established. It is 
then that specific tasks are assigned, eliminating dual respon- 
sibilities and allowing organizational changes to be accommo- 
dated. In general, breakdowns of responsibility for tasks are 
done on a short-term rather than a long-term basis. 

Two major approaches to evaluating the impact of goals 

and objectives are described below.* It is vitally important 

that the basic approach and the specific measures be delineated 

during the goal/objective setting process. 

I, Assessment of program effectiveness by leaders 
and administrators. 

A. Measure the program against standards. 

* 

Adapted from Wilson B. Thiede, "Measurement and Evaluation 
in Adult Education." In Herbert Goldhor, ed., Research Methods 
in Librarianship; Measurement and Evaluation (Urbana, Illinois: 
"-^nivei^ai-ty-of iMinois, Graduate School of Library Science, 
1968) , pp. 88-94. 
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B. Measure the program against a hypothetical 
idea of what a "good" program should be. 
(There is no general consensus among li- 
brarians in this area because of its 
subjectivity. ) 

C. Compare one library program with that of 
other communities. (This may produce new 
program ideas but is of no great use 

to evaluation.) 

D. Measure the amount of participation, it is 
assumed that if people continue to participate, 
the program must be good. 

II. Measurement of attitude change, knowledge acquired, 
or problems solved based on measurable objectives. 
(There are few standardized measurement techniques 
and indicators in the library field.) 

Criteri a for Evaluating Goals and Objectives 

How can objectives be ranked according to their priority 
and what criteria will he used to achieve this ordering? 

In assessing needs, setting objectives, and evaluating 
results, the decision-making group should select criteria so 
that judgments will be based upon a generally acceptable 
standard, rule, or test. This helps prevent subjective de-rsic 
making, cost is an obvious criteria for ranking and evdluatinc 



the feasibility of objectives. What is the dollar cost and 
social benefit of meeting a need compared to the costs of 
ignoring it? The interrelationships among objectives should 
be clearly shown in order to avoid conflicts of authority, 
gaps in service, and duplication of effort. 

INPUT EVALUATION 

Alternatives 

Consideration of alternative strategies to achieve 
objectives is a significant aspect of planning. The various 
possible approaches to implement an objective should be 
identified and analyzed. For example, a library wishing to 
promote greater circulation of certain materials would have 
several options available: prime display location for the 
books, list of books available within the library, and news- 
paper or broadcasting advertising. Along with budgetary and 
personnel factors, it is also important to weigh such conse- 
quences as political impact and the effect of a particular 
alternative on future maneuverability. 
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Analysis of Alternatives 
A. General 

!• What is the full range of alternative means 

to achieve targets? 
2. What changes in law, rules, regulations and 

standards might assist the library system 

to reach various targets? 
3« What changes in organizational relationships, 

programs, and activities might assist the 

library to reach various targets? 

B« Pros and Cons 

How feasible is each of the identified alternatives? 

1. Is the cost of each alternative reasonable? 

2. How feasible are the organizational and/or 
other changes implied by each alternative? 

3. What are the possible unintended consequences 
of each alternative? 

C. What resources are required to implement each 
alternative? 

1* What physical facilities, staff, and other 
resource requirements are required by each 
alternative? 

2. What time-scheduling options and constraints 
exist for implementation of possible alterna- 
tives? 

D. What financial resources are required to implement 
each alternative? 

1. What financial resource expenditure pattern 

is implied by changes in organization, programs, 
and activities dictated by various alternatives? 
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2. Are current prices appropriate for calculating 
costs? 

3« If not, what are the assumptions concerning 
changes in the prices of printed and A-V 
materials, etc., on which future expenditures 
are based • 

E. What is the relationship between anticipated conse- 
quences and costs for each alternative (i«e.« which 
feasible alternatives are most cost-effective)? 

Decision Structure 

Who has the authority of deciding among alternative pro- 
grams? System staff, trustees^ member librarians, and non- 
professional staff can provide input with the director. 

PROCESS EVALUATION 
In the process stage programs developed in the Context 
and Input phases become operational. The progress of programs 
using criteria stipulated in the objectives, is evaluated at 
periodic intervals. Process evaluation should be viewed as a 
formal,- systematic examination of progreun status. Results of 
the evaluation constitute the basis for continuance, modifica- 
tion, or elimination of programs. 
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Monitoring^ Criteria 

A. Are the criteria specified in the objective (s) 
being used to evaluate progress? 

B. What additional factors relevant to the program 
should also be analyzed? 

C. Is progress checked at regular intervals? 

D. Is the evaluation data sufficient to provide 
a judgment of progress? 

E« Are the results of the process evaluation put 
into written form and reviewed by appropriate 
personnel? 

Decision Structure 

A. What is the nature of the decision structure 
entrusted with the responsibility for imple- 
menting and reviewing programs? Are there 
major differences in the decision making 
arrangement in the Process phase that were not 
present in the prior planning stages? 

B. Are the lines of authority and responsibility 
clearly described and known to all concerned? 

PRODUCT EVALUATION 
Product evaluation, last of the four CIPP stages, involves 
a final estimate of how well the intentions stipulated in ob- 
jectives have been attained. As in the Process phase, the 
criteria incorporated into the statement of objectives 
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constitute the main benchmarks against which achievement is 
gauged. Results derived from the Product evaluation form the 
basis for the terminal decision on program viability. 

Measuring Attainment of Objectives 

A. Are the measurement devices employed to secure 
data valid and reliable? Has a random sampling 
of users been considered? 

B. Vfhat criteria in addition to those specified in 
the statement of objectives are relevant to a 
final assessment? 

C. Will all persons connected with a progreun be 
asked to contribute their views? 

D. Should a consultant be hired to assist in the 
assessment? 

Common Assessment Factors '^V • . 

A. How much does the program cost? Is the cost 
congruent with initial expectations? What is 
the projected cost? 

B. Did the program meet the overall time schedule? 

■ -V ' C. Are there any unintended or unanticipated conse- 

quences of implemented programs? 

Decision Structure 

[The same comments made about the decision-making 
process in the Process phase apply here.] 



ERIC 
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Goals and objectives are essentially statements of some 
desired future direction. The development of goals and 
objectives allows an orgamization to set targets for future 
action and to assess progress in achieving proposed outcomes. 
Attempts to manage resources, human and material, without 
zucticulating statements of expected results is pragmatic at 
best and conterproductive at worst. The absence of clearly 
defined purposes for organizational activities will often 
adversely affect employee morale, staff productivity, budgetary 
planning, program effectiveness, and task efficiency. In a 
nutshell, if you don't know where you're going, how do you 
know when you get there? And to what degree of success? 

Goal determination and planning are viewed by management 
experts as methods for insuring accountability within an 
organization, and between an organization and its constituency. 
Explicitly stated written goals and objectives inform employees 
of work expectations and provide the institution's con- 
stituency (e.g., taxpayer, user of a product or service) 
with a standard against which to judge organizational in- 
tention and progress. A number of potential benefits can result 
from a concerted effort to delineate organizational goals and 
objectives: 
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— Involves entire organization in seeking solutions 
to common problems and future needs. 

— Requires management to articulate its purposes, to 
review them continually, and to relate broad 
organizational goals to each operational sub-unit. 

— Provides a method for translating goals and 
objectives into meaningful and specific task 
activities. 

— Introduces two-way accountability between manage- 
ment and staff for the achievement of organizational 
commitments . 

Differences Bet ween Goals and Objectives 

While there is considerable discussion in the scholarly 
literature over the definition of goals and objectives, it is 
only important to select the terminology and to use it 
consistently. We shall define goals as relatively broad state- 
ments that imply general movement toward a future point or 
ideal. Goals are not usually measurable in themselves. When 
developing goals, the emphasis should be on the substantive 
value of the proposition or concept being considered and not 
with the availability of resources for immediate attainment. 
A goal relating to the maximization of bibliographic access may 
be perfectly valid, but not be realizable for many years. After 
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goals have been prepared, it is time to br^jak them down into 
manageable, measurable statements reflecting specific program 
directions. These measurable statements are objectives. 
Briefly, an objective stipulates what is to be done, for whom, 
in what length of time, and to what standard of performance. 
In contrast to the ideal orientation of goals, objectives 
must be attainable and therefore derived from a realistic 
assessment of organizational resources (staff, finances, 
materials, etc.). Perhaps an example of an overall goal and a 
supporting objective will make the distinction more clear; 

Goal — to provide library service to the disadvantaged. 

Objective — within a two-year period, the library will 
initiate a summer reading program for disadvantaged children. 
The program's success will be measured by the average nuinber 
of circulations per participant. (Note: There are additional 
criteria against which the success of this program could be 
evaluated; e.g., extent of browsing in the library, number of 
books purchased for home use, impact of the reading program on 
subsequent school performance.) 

Properties of Measurable Objectives 

An objective shall be defined as a specific, written 
statement that indicates what we intend to accomplish to serve 
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the needs we have identified. Objectives have both a present 
and a future context. The present context requires an analysis 
and specification of user needs, identification of goals, 
and a thorough knowledge of available institutional resources 
to implement proposed programs. It is the future dimension of 
objectives that makes them especially important in the planning 
process. To project future actions, a niarober of features 
should be incorporated, whenever possible, into each objective. 
Objectives should contain the following properties or 
components . 

Statement of Purpose .— An objective should convey a pre- 
cise statement of what is to be done. In the field of educa- 
tion, this part of the objective is usually referred to as the 
behavior or impact. For example, an objective which states 
a desire to improve reference service lacks focus and would 
be more properly labeled a goal. To improve the accuracy of 
responses to reference inquiries would be a sharper statement 
of purpose. An objective should also indicate for whom the 
program or action is intended and the projected length of time 
to complete the proposed activity. Key terms or concepts 
should always be defined. In the previous example of an 
objective relating to disadvantaged children, the term 
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"disadvantaged" would require a precise breakdown as to age 
group, economic level, educational attainment, ethnic composi- 
tion, etc . 

Criterion , — Each objective should specify a criterion 

(also known as indicator, standard, unit of measure) against 

which progress toward the objective can be evaluated. Multiple 

criteria may be appropriate for some objectives. The criterion 

is crucial for it provides the basis on which to judge the 

success or failure of attaining the purpose identified in each 

• ■ I- 

objective. Examples of criteria might be the number of 
successfully answered reference inquiries, percentage of area 
industrial corporations utilising library services, and cost 
per circulated volume. A criterion should represent a logical, 
valid measure of the purpose defined in the objective. It is 
entirely possible to develop a worthwhile objective and then 
fail to select an appropriate criterion for assessing the pro- 
posed impact. For example, a definition of library use (a 
criterion for many possible objectives) restricted to door 
counts or circulation transactions would not be a satisfactory 
criterion to measure the value of most library collections. 
Other pertinent aspects of library use might be in-house 
browsing, use of bibliographical tools, number/type of reference 
inquiries, interlibrary loan, and photocopying. 
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Performance Level * — Each criterion should be accompanied 
by a statement of the desired performafrice level. The expected 
performance level for each objective then becomes the precise, 
measurable target against which progress can be evaluated. 
There is no formula for setting a particular level, but it 
should' meet the tests of being both challenging and attainable. 
Using the sample criteria from the previous section, performance 
levels might look like this: 85 percent of all reference 
inquiries will bj correctly answered? 50 percent of area 
industrial corporations should utilize library resources; and 
the cost per circulated volume should not exceed 45C. 

Method of Evaluation . — After determining the statement of 
intended action, the criterion, and the performance level, it 
is appropriate to define how you plan to measure achievement 
of the objective. The choice of measurement devices may range 
from the maintenance of routine records to an elaborate attitude 
survey. It is important to have some knowledge of the advantages 
and disadvantages of major research techniques (survey, observa- 
tion, experimental) . Measurement techniques should be employed 
in a way that will generate reliable conclusions. A telephone 
survey of user attitudes^ toward fine policies in a large city 
that made no provision for contacting persons holding unlisted 
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numbers could introduce sampling bias to the results and they 
may not be generalizaJsle. 

Act iv i ti es/Act io ns . —The last step is to consider the 
range of possible activities to implement a given set of goals 
and objectives. During this phase of the planning process, 
particular attention should be paid to these factors: 
direct, logical relationship between objectives and activities, 
financial considerations, impact on services, manpower re- 
sources, and internal constraints. Although elaboration of a 
set of alternative activities for each objective and justifica- 
tion fojT selecting the optimum approach is time consuming and 
tedious, it will produce a set of objectives, measures, and 
activities which are logically consistent, feasible, and 
attainable. 

Hierarchy of Goals, Objectives, and Activities 

Not all goals and objectives are of the samts importance 
or need to be specified in the same degree of detail. It may 
be helpful to classify goals/objectives in a hierarchical re- 
lationship, starting from a general goal (and possible sub-goals) 
and moving to more refined statements of objectives and their 
associated activities. The following hypothetical example 
graphically illustrates the hierarchical relationship of a goal, 
sub-goal, objectives, and activities/actions (Figure 5). 



Figure 5: SAMPLE HIERARCHY 
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GOAL 

ZIZ 



Expand library service to 
the unserved 



I 



SUB-GOAL 



I 



Improve library service to 
the rural Isolated through 
a Books -by-Mall pro gram 

I 



I objective] 



The library will 


attempt to contact 75 percent of those 


in rural ar^as 


and strive for regular service to 25 percent within one year. Regular 


use shall be defined as four requests per user per year. 




ACTIVITIES 




ACTIVITIES 




ACTIVITIES 


(Bibliographic) 




(Facilities) 




(Personnel) 


1 


r 


1 


Survey other 




Obtain work 




Recruit new 


books-by^mall 




area 




librarian to 


operations 




supervise 






Purchase sup- 




project 


Investigate 




plies for 


i 


production 




mailing oper- 




Assign one 


costs of a 




ation 




clerk from 


catalog 


1 




existing 


1 


Install spec- 




staff 


Select multi- 




ial shelving 


1 


media titles 




to accom- 




Project super- 


based on re- 




modate mate- 




visor to re- 


views and 




rials to be 




ceive train- 


user Inter- 




mailed 




ing in public- 


est survey 


1 


ity and basic 


1 


Reassess 




elements of 


Produce, dis- 




supply and 




evaluative re- 


tribute , eval- 




equipment 




search 


uate catalog; 




requirements 


1 


and monitor 




on continu- 




Perform eval- 


use of the 




ing basis 




uation of pro- 


service 








ject staff 
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The following sample objectives, applicable to any type 

of library, illustrate the range of functional areas that can 

be translated into measurable statements. 

I. OBJECTIVE ; interlibrary loan requests will be processed 
within a specified response time, A loan request 
is considered processed when the desired item is 
either located and forwarded from local resources or 
referred to an external agency for fulfillment. 
This objective shall be attained within one year. 

Criterion ; number of dayg^ to process a request. 
Performance Level : present — 2,5 days; expected — 1 day 
(Note: performance level pertains to at least 

85 percent of the transactions,) 
Activities/Actions : increase staff size; improve 

verification standards and searching competence 

of staff. 

Method of Evaluation : time study based on random 

sample of transactions, 
Respons ib i 1 i ty : interlibrary loan librarian, 

II, OBJECTIVE : within eighteen months, the library will 

initiate a systematic weeding program, which shall 
continue indefinitely. Weeded materials may be 
either discarded or placed in storage. 

Criterion : percent of the collection reviewed 
annually. 

Performance Level : 20 percent of the collection 
will be evaluated annually, (Some portions of 
the collection will be reviewed more often than 
once every five years.) 
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Activities/Actions ; identify specific criteria for 
weeding (e.g., past circulation rate, language); 
develop a set of instructions for the weeding 
staff; and utilize outside consultants as 
required* 

Method of Evaluation ; checklist of collection seg- 
ments reviewed by the staff. Effectiveness of 
the sp-acific weeding criteria can be cross- 
checked by comparing weeded titles against sub- 
sequent demand and purchases. 

Respons ibi li tv : system librarian* 

III* OBJECTIVE ; the library will strive to furnish correct 
answers to 80 percent of the reference inquiries 
received and accepted. This project will require 
two years* 

Criterion ; percentage of accurate responses to 
reference questions. 

Performance Level ; present — 52 percent; expected — 
80 percent. Knowledge of the present accuracy 
rate, of course, presupposes that an evaluation 
of accuracy has already taken place. 

Activities/Actions ; in-service training for staff 
and/or upgrading quality of the collection. 

Method of Evaluation ; ask an outside expert on 
reference service to prepare and administer a 
set of questions, written and oral. Questions 
will be administered unobtrusively and obtrusively. 

Responsibility ; reference librarian. 
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While this section has concentrated on the characteristi 
of goals and measurable objectives, it is important not to lose 
sight of the paramount purposes of planning and evaluation: 
to stimulate a team approach to problem solving and to serve 
more effectively the changing needs of the library's con- 
stituency. Once identified, goals and objectives should be 
periodically reconsidered to take account of new conditions 
and for the salutary effect of rethinking an organization's 
mission. 

Validity of Objectives 

There are several attributes of an objective that deter- 
mine whether or not it is a valid proposition: 

1. Is it a guide to action? Implicit in this question 
is the requirement that a statement must specify 

a future action or impact. A general goal or 
philosophical assertion will not suffice at this 
point. 

2. Does the objective contain a precise statement of 
the criterion or standard against which progress 
can be evaluated? Does each objective pinpoint 
the performance level for each criteria? 

3. Does the objective suggest some method of measure- 
ment? There is only one way to evaluate progress 
toward reaching an objective — through some form 

of measurement keyed to the proposed action or 



activity. We have already referred to the fact 
that the type of measurement must be relevant to 
the objective, its criterion, and the kind(s) of 
information needed to evaluate attainment of the 
ob j ect ive . This step should be confronted and 
articulated to the maximum possible extent at 
the same time that goals/objectives are con - 
structed ^ 

Does the objective reflect external (e*g*, popula- 
tion, legislation) and internal (e«g«, financial 
resources, staff) constraints? 

Does each objective relate to the broader goal(s) 
and provide guidance for the generation of sub- 
ordinate activities? 
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VI. APPLICATION OP THE CIPP MODEL TO THE INTERLIBRARY 
LOAN OPERATION OF A HYPOTHETICAL LIBRARY SYSTEM 

Introduction 

In this section, the Context Input Process Product model 
is applied to the central interlibrary loan operation of a 
hypothetical public library system. The interlibrary loan 
unit is staffed by two library clerks, a part-time librarian, 
and processes approximately 9,000 transactions per year. The 
first part will formulate some of the numerous questions that 
should be asked and answered during the planning stage. The 
list is by no means exhaustive. The second part will delineate 
several specific goals, objectives, and activities for imple- 
menting an effective interlibrary loan network. 

CIPP Model Analysis 

Context (present operation, user needs, problems, 
opportunities) . 

— Identify present interlibrary loan policies and 
objectives. 

— Who establishes policy? 

— Is a procedures manual available? 
-- Who is served by interlibrary loan? 

— What types of materials are loaned? 

— What is duration of loan? why? Renewable? 

— What forms are required to request an item? 
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Are telephone requests allowed? 

What verification procedures are used? 

What types of materials are requested (fiction, non-- 

fiction, journals/ etc* ) ? 

What is the age, educational level, and occupation 
of users? 

How are materials delivered? 

How many requests are referred within the system? How 
many requests are referred to external agencies? 
What is the cost per transaction? (Include staff, 
postage, insurance, photocopy, delivery, etc,) 
What is the percentage of filled and unfilled re- 
quests? 

What record-keeping procedures are employed? Are 
they sufficient for useful feedback on program 
effectiveness/efficiency? 

Inte-^'library loan staff: number, qualifications, 
competence? 

What is the relationship of inter library loan to 
collection development, both at the system head- 
quarters and member libraries? 

How much money is locally allocated (e.g., staff, 
supplies) to interlibrary loan? 
Are library patrons aware of the service? How? 
What assistance is available to each patron in 
filling out a request? 

Do the loan policies of external agencies help or 
hinder your service? 

What major problems can be identified (e.g., money, 
staff, time, user complaints)? 
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— What objectives have you selected? Why? 

— What performance indicators were chosen? Why? 

— What is the level of performance for each desired 
result? Basis for selection? 

Input (analysis of alternative strategies for achieving 
objectives) • 

— What different approaches to service were identified? 
Which one was selected? Why? (Different service 
approaches might include decisions relating to 
circulation of non-print and reference materials # 
delivery speed, staff size, etc. ) • 

— Was cost data available for each potential program 
alternative? 

Process (continual feedback on program successes and 
failures) • 

— What indicators have been selected to monitor pro- 
gram progress? 

— What methods will be employed for data collection 
(e.g., on-going records, questionnaires, inter- 
views) ? 

— What service improvements or defects have been 
noted (e.g., number of users, percent of 
filled/unfilled requests, verification time, number 
of external referrals, loan period, transit time)? 

— What program modifications have been instituted 
based upon performance feedback? 
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Product (termainal evaluation of program objectives). 

— What methods were employed to measure ob- 
j ectives? 

— Are they appropriate? Feasible? 

— Did interlibrary loan performance meet 
specified objectives and criteria? 

— In which area(s) was performance above and 
below expectations? 

Specifying Goals and Objectives; An Example 

This section contains a list of rather broad program 
goals. A selective list of specific, measurable objectives is 
then presented. For each objective there is a criterion or 
indicator (e.g., processing time, percent of requests 
filled/unf illed) and performance levels or standards for each 
criterion. These criteria and their associated levels of per- 
formance will be used to monitor program progress and to assess 
final results. Goals and objectives in this example are 
scheduled for completion within two years. A detailed data 
recording system will be employed during the project. 
Planning Goals 

1. An interlibrary loan unit will be maintained 
by the system to serve member libraries and 
their users. 
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2. Service will be available to all area residents 
holding a library card. 

3. Materials in all formats will be loaned within 
the system. 

4. Interlibrary loan transactions will abide by 
applicable codes. 

5. A manual of procedures for verification, trans- 
mittal, etc., will be prepared and distributed 
to member libraries. 

6. Achievement of optimal processing time for each 
regxTest will be stressed. 

7. Delivery time should be reduced. 

8. The interlibrary loan unit will maintain a close 
liaison with the acquisition department (s) for 
the purpose of relating interlibrary loan activity 
to collection development requirements. 

9. The system will explore the possibility of 
achieving reciprocal borrowing arrangements 
with adjacent public library systems and 
academic libraries. 



Selected Measurable Objectives 

I. OBJECTIVE ; library users should become more aware of 
interlibrary loan service. 

Criterion ; percent of users aware of service. 

Performance Level : present — 15 percent; expected — 
60 percent. 

Activities/Actions ; library displays and pamphlets; 
more intensive promotion by applicable staff at 
member libraries; in-setvice training for all 
staff. 
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Method of Evaluation ; mail survey questionnaire to 

sample of area library users. 
Responsibility ; interlibrary loan librarian. 

II. OBJECTIVE ; the level of user satisfaction with inter- 
library loan service will be assessed. 
Criterion ; percent of users rating the service 

as "good" or better 
Performance Level ; present — 40 percent; expected — 
75 percent. 

Activities/Actions ; reduce processing time; higher 
fill rate; client centered approach to user. 

Method of Evaluation ; mail survey questionnaire to 
sample of interlibrary loan service users. 

Responsibility ; interlibrary loan librarian. 

III. OBJECTIVE ; a satisfactory "fill rate" from internal 
sources should be achieved. 

Criterion ; internal fill rate-^percentage of re- 
quests that can be filled by system libraries. 

Performance Level ; present — 60 percent; expected — 
80 percent. 

Activities/Actions ; quantitative and qualitative 
improvement of member library collections; 
modification of selection policies (subject 
areas« multiple copy needs) based upon analysis 
of interlibrary loan requests. 

Method of Evaluation ; examination of statistical 
records. 

Re spons ib i 1 i tv ; interlibrary loan librarian, 
system director, and member libraries. 

ERLC 
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IV. OBJECTIVE : a 20 percent cost reduction per transaction 
should be attained. (Note: For the various cost 
categories of an interlibrary loan operation, 
consult Vernon £• Palmour and Lucy Gray, Costs 
and Effectiveness of Interlibrary Loan and Refer- 
ence Activities of Resource Libraries in Illinois . 
Springfield, Illinois State Library, 1972.) 

Criterion : cost per transaction. 

Performance Level : present — $3 . 55 ; expected — $2 . 84. 
Activities/Actions : initiate time and motion 
study of processing activities; improve 
searching and verification procedures at head- 
quarters and at local level; employ a library 
technical assistant to supervise searching; 
eliminate two relatively untrained clerks. 
Responsibility : interlibrary loan librarian. 

OBJECTIVE : the bibliographic accuracy of requests sub- 
mitted from each member library will be upgraded. 
Criterion: percent of acceptable bibliographic 

citations submitted from member libraries. 
Performance Level : present — 65 percent acceptable 
from each library; expected — 90 percent 
acceptable from each library. 
Activities/Actions : periodic training sessions 

condicted by headquarters staff for member li- 
brary personnel; staff visits to selected member 
libraries to rectify recurring deficiencies. 
Method of Evaluation : quarterly examination of all 

requests and judgment on their acceptability. 
Responsibility : interlibrary loan librarian. 
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APPENDIX A 



FLOWCHART OP THE CIPP 
EVALUATION MODEL 



KEY TO SYMBOLS: 

Direction of planning steps 
Feedback 



Note: New programs and projects should begin at the Context 
step and proceed through the CIPP model. Programs 
that are operational will normally enter the model 
at the Process stage, unless a total reevaluation is 
undertaken. 



ERIC 



CO 
(0 

0 (0 



o 



0 



0) 
0^ 



■P 

« CO 

■p 

3 -p 
ft o 
c :) 

H 

0 

g M 

o cu 

M 





— 3 






<D 






U 






C 












g 


•H 










0 


0) 






4J 




u 


•H 




0) 


}^ 






U 










(A 






0) 




c 


> 




rd 


•H 






4J 




(0 


U 




H 


0) 






•n 




0 Si 




o 


O 














> 


(0 




•H 






U 


0) 




0) 


0) 


f 


Q 




> 






+J 


ih 




C 


0) 




0) 


•H 




£ 


4J 




(0 


•H 




(0 


> 




0) 


•H 




0) 


4J 




(0 


U 




< ft 








0) 


/ c 




/ 0 




/ •'^ 


4J 


v/ w 


U 


X •H 


3 



ERIC 




0 






•H 










(0 


ft 




u 


n> 


1 


•H 




0 


4J 






(0 


I 


u 


•H 












0) 




6 


4J 





(0 




0) 


1 0) 




(0 > 




•H •H 






ro 






hi H 


(A 



D> 

<d 
to 

X 
V 

c 
o 











(0 




% 






u 


H 




c 




0) 




•H 




c 






0) 


c 


• 






0 


u 


4J 




(0 




(0 






0) 


c 


n 


0) 




0 








u 









52 



> 

•H 

U 

I) 

I 



id 
0 
O 

M-l 
O 

c 
o 

•H 

u 

(0 

c 



V 
0) 

o 
d 

0) 

6 



(A 
(0 



I 



H 

I 



04 

S3 



C 0) 
(0 0> 
n) 

(0 4J 
(0 (0 
4) 



u 

0 
V4 



u 

3 



04 

0 



i 



0« 



53 









§ 


u 


•H 


0 






(d 






nt 


c 


•H 




M 


g 


0) 


0) 


4J 


H 


•H 




U 


e 


u 


H 



•p 

X 
0) 

0 c 

IM S 





0) 




0) 


0 


> 




•H 


0) 




•H 


nt 


0) 


C 




H 


0) 


n) 


4J 


C 


H 




< 




0) 

en 





(0 




0) 


c 


> 


a; 4: 


•H 


i 






u 




0) 


•H 


•n 


H 




< 






1 

0) 




> 




•H 




4J 




U 






(0 


(0 ^ 


(0 


0 ^ 


0) 




c 





(0 




c 




0 




. U 




9 
CO 

to 
to 

V 

u 

0 

u 

0< 

0 
H 



c 

•H 

0) 0) 

(U (0 
(h (0 
0 



(0 

> 

•H 
<0 

c 
u 

0) 
4J 



0 

c 

g 

(0 
(0 
0) 
(0 
(0 

4: 
c 

10 

c 
o 

•H 
4J 
10 

u 

•H 
•H 

c 

0) 
TJ 
H 



< 1 



tz; 
o 

H 

I 



> 
H 

(A 
(A 

U 

s 

pit 



CP 

(d 
Ui 

■p 

u 

0 
T3 
0 
U 

6 

0 

u 












•H 


(0 


M 


-H 


0 




+J 


(U 


•H 


+J 


c 


-H 


0 


M 




U 





0 CM 
u c 

M-l H 



CP 

n) 



(U 
CP 

Id 

u 

3 
Tt 
O 
U 

0 



(A 



U 
0 

m 

(A 
0) 

u 

? 

♦H 

O 
■P 
♦H 

c 
o 



M 




(U 




•H 




H 




U 












0 









55 




H 

i 



1 

04 



0) 




> 


(0 


•H 


+J 


•P 


H 


•H 




(0 


(0 


0 


0) 


CU 





I ■ 




C n) 








c 




(0 0) 




i 




H g 


(0 


3 0 


C 


(0 U 


0 


0) 0) 


•H 




■P 



0) 




> 




0 -H 




+J 




C 0 


c 


0 0) 


0) 


•n -n 6 




H 


Id o 


H 




i-t H 




n) Id 


H 


> 0 










ERIC 



(0 
(0 

0 0 

u u 



0) 

Id 

0) 



u ^ 

0) (0 

•H 0) 

H a» 

M Id 

Id -P 

0) (0 

0 

4J 






(0 








0 


+J 


+J 


(0 


u 


0 


Id 


U 


b 



? 

♦H 

•P 
U 
Q) 

§ 

O 
•P 

c 
o 

•H 

•p 

(0 
H 
0) 

c 

♦H 

(0 

§ 

0> 

o 
u 
cu 

o 

(A 
(0 

c 

> 
•H 

t 

IH 
IH 
U 



I 



56 



APPENDIX B 



DATA COLLECTION CATEGORIES- 
CONTEXT PHASE 



ERIC 



DATA COLLECTION CATEGORIES— CONTEXT PHASE* 



Population 

A. Table of System Area Census by County 

County A County B 

1. Land Area (sq. mi.) 
Change, 1960-1970 
Total 

Net Migration 

2. Female 

3 . Race 
White 
Negro 

4. Age 

18 and Over 
65 and Over 

5. Foreign Stock 
Total 

Leading Country of Origin 
Spanish Heritage 

6. Educational Level of Persons Over 25 
Total 

4 Years High School 
4 Years College 

7. Students 

Persons 3-34 Enrolled in School 

Kindergarten 

Elementary 

High School 

College 

8. Employment 

Wholesale and Retail Trade 
Professional-Managerial 
Sales and Clerical 
Craftsmen and Foremen 



* 

Sources of information: U.S. Census for 1970/ State 
Library Census Reports, County Data Book and System Planning 
Data. 
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9. Median Family Income 
Total 
White 
Negro 

10. Housing 

In One-unit Structures 

In Structures Built Prior to 1950 

Owner Occupied 

Moved into Unit During 1965-70 • 

11. Population 
Urban 

Rural Non-farm Population 
Farm Population 

Total 

Change 

12. Farms 

Total 

Change 
Size of Farm 

Average 

Under 10 Acres 

1#000 Acres or Over 
Operated by Corporations 
Sales $10,000 - 39,000 
Crops 

Dairy Products 

Livestock 

Poultry 

Working 100 or More Days off Farm 



B. Items of interest: 



1. Age groupings of population— analyze holdings of the 
system. Does the present collection of materials pro- 
vide for children, for young adults, for adults, and 
for older people? 

2. Religious characteristics of population may be of help 
in contacting organizations about advertising services 
offered by member libraries and system. 
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3. Population by county for 1970; could be compared with 
1960 census figures to show areas of growth and de- 
crease in population. 

J-960 1970 Difference 
Example: 

Smith County + or • 

4. Urban-rural characteristics by county 

Example of table: 

Total Pctg. Pctg. Pctg. Number 
System Farm- of Pop. of Pop. of Farm 
County Pop. land Rural Urban Families 

5. Number of registered voters by county. 

6. Niirober of political units by county — the total number 
of cities, incorporated towns, and villages; the types 
of school districts which would encompass elementary 
and unit, high school, and junior college levels; and, 
special districts for fire protection, parks, sanitary, 
forest preserves, airports, hospitals, etc. 



II* Listing of geographic conditions which affect library service < 

A. Travel distance to system, state roads and interestate 
system access to system, ease of travel between member 
libraries. 

System boundaries — can be shown on a map. 



III. Listing of institutions which affect library service. 

A. Correctional institutions (prisons, county jails, 
reformatories, etc.) . 

B. Academic institutions (colleges, junior colleges, business 
schools, etc. ) . 

C. Medical institutions (hospitals, mental institutions, 
trauma centers, etc.). 

D. Industries (major ones with libraries or major industries 
which greatly affect the mobility and economical-educational 
level of a community) . 
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A. 
B. 

C. 
D. 
E. 



Social service institutions (those that are staffed in a 
permanent building, such as day care centers, nursing 
homes, help for the handicapped, facilities for the poor 
or elderly, etc.)* 

Other — list media information agencies in each community 
such as television and radio stations, newspapers (daily 
and weekly), bookstores (number only), and extension 
agencies of local, state, or federal agencies (i.e.. 
County home extension, college extension groups) . 



History of the system. 

Services provided by the system under the law (See 111. 
Rev. Statutes 81:113). 

Plan of Service. 

Current services offered to member libraries by the system. 

Narrative about the system and member libraries. 

1. Nxaraber of counties. 

2. Number of endowed libraries, if any. 

3. Number of people who live in tax-supported areas for 
library service. 

4. Levy rates of member libraries. 

5. Other sources of funds for member libraries: fines, 
gifts, revenue sharing, unexpected balances, etc. 

6. Library expenditures. 

7. Per capita support of libraries. 

Example of table: 



IV. Background of Library System 



Per Capita 
Support 



Number of 
Libraries 
in Category 



Percent 
of Total 
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8. Educational level of member library staffs, 
Example of table: 



Number with 
Less than 
Bachelor's 



Number with 
Bachelor ' s 



Number with 
Fifth Year 
or Higher 



Number 
with 
M »L » S » 



9. Data on member libraries — users, buildings, collections, 
and transactions by type of material. 



Examples : 



TABLE 1 



Popula- 
Library tion 



Borrower Characteri sties 



Registered 
Borrowers 



Non- Non- 
registered residents 
Population Registered 



Library 



TABLE 2 



Library Buildings 



Build- 
ing 
Built 



Latest 
Remodel- 
ing 



Handi- 
capped 
Access 



Library 



TABLE 3 

Volumes Added to Member Libraries Served 

by the System from Beginning of 
System Operation to Present 



1965-66 



1966-67 



1973-74 



I 
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TABLE 4 



Transactions by Type of Material 



Type Non- 
of Li- Year Bldg. No. of Popula- res. 
Library brarv Est» Built Seats tion Fee 



Hrs. Total 
Open Staff 
(wk) (FTE) 



Vols. 
Total Adult 
Trans. Books 



Vols. 

Juv. Sound 
Books Rec. 



Films Periodicals Tax Total 

(8inm & Vols. Tax Levy Expen- 

ISmm) Subs . Vols. Micro. Rate Rec. diture 



10. You can take the Illinois standards, "Measures of 

Quality, " and in table form compare the standard with 
the resources of member libraries. 

Example of table: 

Illinois Standard Book Collection 

Population up to 4,999 15,000-20,000 Vols. Minimum 

5,000-9,999 4 books per capita 

10,000-24,999 3*5 books per capita 

No. of Libraries No. of Libraries 

by Population which Meet Standard 

No. Pet, in Category 

Similar tables could be set up for periodicals, hours 
open per week, and recordings held. 



F. List non-member libraries. 

G. Unserved areas. 

1. Table showing unserved residents by county. 

2. Map of system showing areas which have no tax-supported 
libraries. 
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REPORTING FORMS 
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GLOSSARY OF TERMS* 



Account abi 1 ity—The ability to account for past actions in 
relationship to the decisions which precipitated the 
actions, the wisdom of those decisions, the extent to 
which they were adequately and efficiently implemented, 
and the value of their effects. 

Evaluations-Evaluation is the process of delineating, obtain- 
ing, and providing useful information for judging decision 
alternatives. 

Planning— A detailed program or method worked out beforehand 
for the accomplishment of a project or goal. 

CIPP— An acronym formed from the first letters of the four basic 
kinds of evaluation: Context, Input, Process, Product. 

Context evaluation— This type of evaluation provides a 

rationale for determination of objectives for the system. 
It defines the environment, describes the desired and 
actual conditions pertaining to the environment, identifies 
unmet needs and unused opportunities, and diagnoses the 
problems that prevent needs from being met and opportunities 
from being used. 

Input evaluation— This type of evaluation provides information 
for determining how to utilize resources to meet program 
goals. After objectives have been chosen, alternative ways 
to achieve the objectives are identified and assessed before 
a final program is decided upon. 



* 

Adapted from Daniel L. Stufflebeam, "The CIPP Model of 
Evaluation," In David D. Thomson, ed.. Planning and Evaluation 
for Statewide Libra ry Development; New Directions . Columbus, 
pp. 34-42^. 
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Process evaluation — A program is chosen and the persons 

responsible for implementing plans and procedures provide 
periodic feedback information to the rest of the planning 
group. This type of evaluation has three objectives: 

(1) to detect or predict defects in the procedural design 
or its implementation during the implementation stages; 

(2) to provide information for making decisions; and 

(3) to maintain a record of the procedure as it occurs. 

Product evaluation — This type of evaluation measures and 
interprets attainments at the end of the project cycle 
and as often as necessary during the project term. It 
provides information for determining whether objectives 
are being achieved and whether the procedure being used 
should be continued, modified, or terminated. 

Goal — A goal is a statement that is abstract and cannot be 
measured. It implies movement toward an ideal; it is 
Utopian. 

Objective — An objective is a statement which can be measured 
quantitatively. It implies that a person or a system 
does something which can be observed or measured. 

Activities — Activities are the means by which objectives can 
be met. 

Decision maker — The decision maker and the evaluator may be 
the same person. All members of the planning group are 
decision makers in that they provide information or input 
concerning the needs to be served. One person is in 
charge of the planning group (i.e., the library system 
director) to coordinate and direct planning activities. 
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REPORT WRITING* 



1. Set forth the objectives of the library development plan. 
The objectives are usually tentative and not finally 
determined. They have been established after long and 
arduous planning sessions with key members of the staff. 

2. List the kinds of data, statistics, and narrative justifica- 
tions required for each objective. For every objective in- 
cluded in the plan there will be a proper rationale asso- 
ciated with it. Such a listing is critical, since certain 
objectives may show up as infeasible when the implications 
of the justification requirements are seen in sharp focus. 

3. Indicate by objective, the staff requirements and all other 
attendant costs. At this stage, without all of the data 
completed, staffing and other costs involved in implementing 
the plan can only be approxirriated. It is an important step, 
however, to make these estimates since a realistic assess- 
ment of the total costs must be made early enough to recall 
or eliminate certain objectives if necessary. It is 
imperative that estimates by objective can be made so that 
staff will have a handle-hold on specific problem areas. 
The important point is that budgeting follows rather than 
precedes planning. 

4. Make final refinements in the list of objectives and 
establish priorities. On the basis of analysis in 
steps 2 and 3, all objectives should now be agreed to and 
ordered as to implementation, target dates, and dollar 
priority. 



*From Robert L. Goldberg, "Report Writing," In David B. 
Thomson, ed.. Planning and Evaluation for Statewide Library 
Development: New Directions, pp. 105-110. 
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5. Complete all data gathering, statistical tables, and 
narrative justifications* If possible, specific staff 
members should be assigned responsibility for completing 
various tasks derived from objectives. 

6. Develop cohesive statement of total plan embracing all 

of the objectives. The development of a complete statement 
will give coherence to the total plan that a simple list 
of objectives cannot do. 

7. Prepare first draft — rough copy only. 

8. Develop final draft. 

9. Review final draft. No one who has an emotional stake in 
the formulation, rhetoric, or style of the report should 
participate in this critical review. 
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